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IMAGE COMPRESSION APPARATUS, IMAGE DECOMPRESSION APPARATUS, 
IMAGE COMPRESSION METHOD, IMAGE DECOMPRESSION METHOD, 
PROGRAM, AND RECORDING MEDIUM 

CLAIM OF PRIORITY 

[0001] The present application claims priority to the corresponding Japanese 

Application No. 2003-037972, filed on February 17, 2003, the entire contents of which are 
hereby incorporated by reference. 

BACKGROUND OF THE INVENTION 

Field of the Invention 

[0002] The present invention relates to an image compression apparatus, an image 

decompression apparatus, an image compression/decompression apparatus, an image 
compression method, an image decompression method, an image 
compression/decompression method, a program, and a recording medium. 

Description of the Related Art 

[0003] In recent years and continuing, there is considerable spread in the use of 

images with high quality. This is largely due to input devices (e.g., digital still cameras, 
scanners) and output devices (e.g., inkjet printers, displays) serving to handle high quality 
images. Among algorithms handling still images of high quality, JPEG (Joint Photographic 
Experts Group) is, at present, most widely used. In eliminating the redundancy of spatial 
areas, JPEG employs a two-dimensional discrete cosine transform. 

[0004] A basic function of this transform type is merely to compress and decompress 
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still images. The JPEG type is neither able to manipulate images in a compressed state or 
view a particular area during decompression. In addition, the JPEG type handles an image as 
a flat structure that has no hierarchy. Accordingly, encoded data must be completely decoded 
in order to perform a new process on an image. 

[0005] With the JPEG algorithm, as an image is provided with a higher fineness or 

larger scale, that is, as the number of pixels of an original image increases, the time required 
for decompressing the encoded image and displaying the image on a display device will also 
increase. Such increase has reached a level that it can no longer be ignored owing to the fact 
that fineness and area of an original have increased due to the improvements in the 
performance of recent input devices. It is also a concern for areas related to handling of 
satellite/aerial photographs or medical/scientific images, and areas related to recording 
images of cultural assets. It is to be noted that the time required in decompressing a JPEG 
compressed image has a characteristic of being a certain value having no relation to the 
compression ratio. This is due to the fact that JPEG compressed data must be completely 
decoded regardless of compression ratio. 

[0006] Generally, displaying all pixels of a large image is difficult in that there is a 

restriction on the number of pixels that can be displayed on a display device. This is, 
therefore, actually dealt with by reducing the image on the display. Nevertheless, even in 
displaying a reduced image with a conventional JPEG algorithm, it is required to obtain every 
pixel value by decompressing the entire original image, and then conduct a pixel skipping 
process. The decompression time for obtaining every pixel value of the original image 
increases in proportion to the number of pixels of the image. Although the time may also 
depend on the performance of the CPU or the capacity of the memory, it takes, for example, 
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several minutes to several tens of minutes until the image is displayed. 
[0007] With the conventional JPEG algorithm, even in a case where sufficient 

information can be obtained without conducting a complete decoding process, such complete 
decoding process is necessary, and it is impossible to designate an image area targeted for 
decompression or an order (sequence) for performing decompression in a decompression 
process. The conventional JPEG algorithm has difficulty in meeting the needs such as 
displaying a color image with a gray scale image, viewing only a certain area of an image, 
viewing an image in a thumbnail size, accessing image contents at high speed, or viewing a 
fast forward display of a motion image. With the JPEG algorithm, first, image data are 
generated by performing a complete decompression process on encoded data of an original 
image. Then, a desired image is obtained by transforming the generated image data into, for 
example, image data for gray-scale display, image data for display of a particular area, or 
image data for thumbnail display. 

[0008] Meanwhile, images are often displayed in thumbnail form by image display 

apparatuses. As for conventional techniques of displaying in thumbnail form, there are, for 
example, a method of decompressing an entire image and setting an appropriate resolution 
for the image, or a method of separately storing a thumbnail image. In any of such 
techniques, compression/decompression of an image is conducted by using basic functions of 
the JPEG standard or in some cases expanded functions. It is to be noted that a thumbnail 
image is an image that is output (e.g. displayed, printed, and/or transmitted) in a condensed 
form of a desired code size. 

[0009] Nevertheless, a large amount of time is required for outputting (e.g. displaying, 

printing, and/or transmitting) a thumbnail image in a case of employing a thumbnail 
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outputting method conducted by decompressing an entire image and setting a suitable 
resolution for the image. 

[0010] In a case of employing a thumbnail outputting method conducted by separately 

storing a thumbnail image, data of a thumbnail image (small-sized image) itself are generally 
stored in a header portion of compressed data of a main image, as with, for example, Exif 
(Exchangeable image file format). Although this method is able to increase output speed, 
this method requires large storage capacity for compressed data. 
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SUMMARY OF THE INVENTION 

[0011] An image compression apparatus, image decompression apparatus, image 

compression method, image decompression method, program, and recording medium are 
described. In one embodiment, the image compression apparatus comprises: a code size 
setting unit setting one or more code sizes; a compressing unit compressing an image that is 
divided into a plurality of image quality levels in accordance with the code sizes; and a code 
generating unit generating code being dividable into each code size. 



Patent Application 
170204/(MJM:dlr) 



Page 5 of 52 



006453.P037 

Express Mail Label No. EV 409361254 US 



BRIEF DESCRIPTION OF THE DRAWINGS 

[0012] Fig. 1 is a block diagram for illustrating the hierarchical encoding/decoding 

algorithm serving as a base of a JPEG 2000 scheme; 

[0013] Fig. 2 is a sequence of diagrams for illustrating an algorithm of a JPEG 2000 

scheme; 

[0014] Figs. 3A through 3D is a set of schematic diagrams showing sub-bands for 

each decomposition level in a case where the number of the decomposition levels is 3; 
[0015] Fig. 4 is a set of schematic diagram showing an example of each component of 

a color image divided into tiles; 

[0016] Fig. 5 is a schematic diagram showing a relation between precincts and code 

blocks; 

[0017] Fig. 6 is a table showing an example of packets and layers in a case where the 

number of the decomposition levels is 2 (resolution level = 3), in which an example of a 
typical layer structure is illustrated; 

[0018] Fig. 7 is a table showing an example of packets and layers in a case where the 

number of the decomposition levels is 2 (resolution level = 3), in which an example of a layer 
structure being able to output thumbnails according to respective apparatuses is illustrated; 
[0019] Fig. 8 is a table showing an example of packets and layers in a case where the 

number of the decomposition levels is 2 (resolution level = 3), in which an example of a layer 
structure being able to output thumbnails according to the capacity of a transmission line is 
illustrated; 

[0020] Fig. 9 is a data diagram showing a format of code data (code stream structure) 

of JPEG 2000 that is generated from a code generating process; 
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[0021] Fig. 10 is a data diagram showing a structure of the main header structure in 

Fig. 9; 

[0022] Fig. 1 1 is a schematic diagram showing a structure of a file format of a basic 

JPEG 2000 scheme; 

[0023] Fig. 12 is a block diagram for illustrating an example of a structure of an 

image compression apparatus according to an embodiment of the present invention; 
[0024] Fig. 13 is a flowchart for illustrating an image compression method 

(procedure) conducted in Fig. 12, and for illustrating an example of steps conducted with an 
image compression method according to an embodiment of the present invention; 
[0025] Fig. 14 is a table showing an example of a corresponding relation that is 

employed by the image compression apparatus of Fig. 12; 
[0026] Fig. 15 shows an example of an original image; 

[0027] Figs. 16A through D show resultant images processed by an image 

compression apparatus and output from an image decompression apparatus according to an 
embodiment of the present invention; and 

[0028] Fig. 17 is a block diagram showing an example of a structure of an image 

compression apparatus and/or image decompression apparatus according to an embodiment 
of the present invention. 
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DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0029] In order to solve the difficulties described above, the applicant of the present 

application proposes herein embodiments of present inventions related to a code stream 
forming apparatus, an image decompression system using such apparatus, an image 
decompression apparatus, an image providing system, a code stream forming method, an 
image decompression method, a computer readable program, and a computer readable 
recording medium having such program recorded thereto that can reduce the decompression 
time required for displaying compressed data, that is, a code stream forming apparatus, an 
image decompression system using such an apparatus, an image decompression apparatus, an 
image providing system, a code stream forming method, an image decompression method, a 
computer readable program, and a computer readable recording medium having such 
program recorded thereto, which serve to provide a code stream of still images that allows 
data of very fine images, having been encoded as still images or a moving image formed of a 
sequence of still images, to be displayed at high speed and in a size-reduced manner. The 
code stream forming function of the aforementioned inventions enables efficient image 
decompression by designating an area targeted for decompression or the order of conducting 
a decompression process. That is, such function allows a decompression procedure to be 
specified. 

[0030] The aforementioned technologies proposed by the inventor of the present 

invention are examples that are applied with the expanded functions. 
[0031] One or more embodiments of the present invention include an image 

compression apparatus, an image compression method, a program, and a recording medium 
that substantially obviate one or more of the problems caused by the limitations and 
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disadvantages of the related art. 

[0032] Features and advantages of the present invention are set forth in the 

description that follows, and in part will become apparent from the description and the 
accompanying drawings, or may be learned by practice of the invention according to the 
teachings provided in the description. Embodiments as well as other features and advantages 
of the present invention will be realized and attained by an image compression apparatus, an 
image compression method, a program, and a recording medium particularly pointed out in 
the specification in such full, clear, concise, and exact terms as to enable a person having 
ordinary skill in the art to practice the invention. 

[0033] To achieve these and other advantages and in accordance with the purpose of 

the invention, as embodied and broadly described herein, an embodiment of the invention 
includes an image compression apparatus, having: a code size setting unit setting one or more 
code sizes; a compressing unit compressing an image that is divided into a plurality of image 
quality levels in accordance with the code sizes; and a code generating unit generating code 
being dividable into each code size. 

[0034] According to the image compression apparatus in an embodiment of the 

present invention, the image quality level may be a layer. 

[0035] According to the image compression apparatus in an embodiment of the 

present invention, the image compression apparatus may further include: a reference value 

setting unit setting a reference value corresponding to each code size. 

[0036] According to the image compression apparatus in an embodiment of the 

present invention, the reference value may be the type of a transmission line. 

[0037] According to the image compression apparatus in an embodiment of the 
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present invention, the reference value may be the capacity of a transmission line. 
[0038] According to the image compression apparatus in an embodiment of the 

present invention, the reference value may be the type of an image display apparatus. 
[0039] According to the image compression apparatus in an embodiment of the 

present invention, the reference value may be display resolution. 
[0040] According to the image compression apparatus in an embodiment of the 

present invention, the reference value may be the processing speed of an image display 
apparatus. 

[0041] According to the image compression apparatus in an embodiment of the 

present invention, the image compression apparatus may further include: an embedding unit 
embedding the corresponding relation between the reference value and the code size into the 
generated code. 

[0042] Furthermore, one embodiment of the present invention includes an image 

compression apparatus including: a dividing unit dividing image data into a plurality of 
segments; a code size setting unit setting a code size corresponding to each segment; a 
compression unit compressing the image data by adjusting the segments in accordance with 
the code size; and a code generating unit generating code by referring to the corresponding 
relation between the code size and the segments. 

[0043] According to the image compression apparatus in an embodiment of the 

present invention, the dividing unit may include a unit that divides the image data based on a 
tile, a precinct, or a code block. 

[0044] According to the image compression apparatus in an embodiment of the 

present invention, the segments may be color components. 
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[0045] According to the image compression apparatus in an embodiment of the 

present invention, the segments may be resolutions. 

[0046] According to the image compression apparatus in an embodiment of the 

present invention, the segments may be packets. 

[0047] According to the image compression apparatus in an embodiment of the 

present invention, the image compression apparatus may further include: an embedding unit 
embedding the corresponding relation between the code size and the segment into the 
generated code. 

[0048] Furthermore, the present invention provides an image decompression 

apparatus including: a decompression unit decompressing the code generated from the image 
compression in an embodiment of the present invention. 

[0049] According to the image decompression apparatus in an embodiment of the 

present invention, the decompression unit may decompress the code by referring to the 
corresponding relation between the code size and the reference value. 
[0050] Furthermore, one embodiment of the present invention includes an image 

compression/decompression apparatus including: an image compression apparatus having a 
code size setting unit setting one or more code sizes, a compressing unit compressing an 
image that is divided into a plurality of image quality levels in accordance with the code sizes, 
and a code generating unit generating code being dividable into each code size; and a 
decompression unit decompressing the code generated in the code generating unit of the 
image compression apparatus. 

[0051] Furthermore, one embodiment of the present invention includes an image 

compression/decompression apparatus having: an image compression apparatus having, a 
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dividing unit dividing image data into a plurality of segments, a code size setting unit setting 
a code size corresponding to each segment, a compression unit compressing the image data 
by adjusting the segments in accordance with the code size, and a code generating unit 
generating code by referring to the corresponding relation between the code size and the 
segments; and a decompression unit decompressing the code generated in the code generating 
unit of the image compression apparatus. 

[0052] Furthermore, one embodiment of the present invention provides an image 

compression method including: a) setting one or more code sizes; b) compressing an image 
that is divided into a plurality of image quality levels in accordance with the code sizes; and 
c) generating code being dividable into each code size. 

[0053] According to the image compression method in an embodiment of the present 

invention, the image compression method may further include: d) setting a reference value 
corresponding to the code size. 

[0054] According to the image compression method in an embodiment of the present 

invention, the reference value may be the type of a transmission line. 

[0055] According to the image compression method in an embodiment of the present 

invention, the reference value may be the capacity of a transmission line. 

[0056] According to the image compression method in an embodiment of the present 

invention, the reference value may be the type of an image display apparatus. 

[0057] According to the image compression method in an embodiment of the present 

invention, the reference value may be display resolution. 

[0058] According to the image compression method in an embodiment of the present 

invention, the reference value may be the process speed of an image display apparatus. 
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[0059] According to the image compression method in an embodiment of the present 

invention, the image compression method may further include: e) embedding the 
corresponding relation between the reference value and the code size into the generated code. 
[0060] Furthermore, one embodiment of the present invention includes an image 

compression method including: a) dividing image data into a plurality of segments; b) setting 
a code size corresponding to each of the segments; c) compressing the segments of the image 
data by adjusting the segments in accordance with the code size; and d) generating code by 
referring to the corresponding relation between the code size and the segment. 
[0061] According to the image compression method in an embodiment of the present 

invention, the image compression method, operation a) may further include a step of dividing 
the image data based on a tile, a precinct, or a code block. 

[0062] According to the image compression method in an embodiment of the present 

invention, the segments may be color components. 

[0063] According to the image compression method in an embodiment of the present 

invention, the segments may be resolutions. 

[0064] According to the image compression method in an embodiment of the present 

invention, the segments may be packets. 

[0065] According to the image compression method in an embodiment of the present 

invention, the image compression method may further include: e) embedding the 
corresponding relation between the code size and the segment into the generated code. 
[0066] Furthermore, the present invention includes an image decompression method 

including: a) decompressing the code generated from the image compression method in an 
embodiment of the present invention. 
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[0067] According to the image decompression method in an embodiment of the 

present invention, the code may be decompressed by referring to the corresponding relation 
between the code size and the reference value. 

[0068] According to the image decompression method in an embodiment of the 

present invention, the code may be decompressed by referring to the corresponding relation 
between the code size and the segment. 

[0069] Furthermore, one embodiment of the present invention includes an image 

compression/decompression method including: a) setting one or more code sizes; b) 
compressing an image that is divided into a plurality of image quality levels in accordance 
with the code sizes; c) generating code being dividable into each code size; and d) 
decompressing the generated code. 

[0070] Furthermore, one embodiment of the present invention includes an image 

compression/decompression method including: a) dividing image data into a plurality of 
segments; b) setting a code size corresponding to each of the segments; c) compressing the 
segments of the image data by adjusting the segments in accordance with the code size; d) 
generating code by referring to the corresponding relation between the code size and the 
segment; and e) decompressing the generated code. 

[0071] Furthermore, one embodiment of the present invention includes recordable 

media storing a program to be installed or executed by a computer, the program including: a) 
a setting function setting one or more code sizes; b) a compressing function compressing an 
image that is divided into a plurality of image quality levels in accordance with the code 
sizes; and c) a generating function generating code being dividable into each code size. 
[0072] According to the program in an embodiment of the present invention, the 
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program may further include: d) an embedding function embedding the corresponding 
relation between the reference value and the code size into the generated code. 
[0073] According to the program in an embodiment of the present invention, the 

program may be recorded to a recording medium. 

[0074] Furthermore, one embodiment of the present invention includes a recordable 

media storing a program to be installed or executed by a computer, where the program 
includes: a) a dividing function dividing image data into a plurality of segments; b) a setting 
function setting a code size corresponding to each of the segments; c) a compressing function 
compressing the segments of the image data by adjusting the segments in accordance with the 
code size; and d) a generating function generating code by referring to the corresponding 
relation between the code size and the segment. 

[0075] According to the program in an embodiment of the present invention, 

operation a) may further include a function of dividing the image data based on a tile, a 
precinct, or a code block. 

[0076] According to the program in an embodiment of the present invention, the 

program may further include: e) an embedding function embedding the corresponding 
relation between the code size and the segment into the generated code. 
[0077] According to the program in an embodiment of the present invention, the 

program may be recorded to a recording medium. 

[0078] Furthermore, the present invention provides a program to be installed or 

executed by a computer, the program including: a) a decompressing function decompressing 
the code generated from the program in an embodiment of the present invention. 
[0079] Furthermore, one embodiment of the present invention includes a recordable 
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media storing a program to be installed or executed by a computer, where the program 
includes: a) a setting function setting one or more code sizes; b) a compressing function 
compressing an image that is divided into a plurality of image quality levels in accordance 
with the code sizes; c) a generating function generating code being dividable into each code 
size; and d) a decompressing function decompressing the code generated in operation c). 
[0080] Furthermore, one embodiment of the present invention includes a recordable 

media storing a program to be installed or executed by a computer, where the program 
includes: a) a dividing function dividing image data into a plurality of segments; b) a setting 
function setting a code size corresponding to each of the segments; c) a compressing function 
compressing the segments of the image data by adjusting the segments in accordance with the 
code size; d) a generating function generating code by referring to the corresponding relation 
between the code size and the segment; and e) a decompressing function decompressing the 
generated code. 

[0081] Other and more specific embodiments of the present invention include an 

image compression apparatus, an image compression method, a program, and a recording 
medium for conducting a transformation process in accordance with a targeted output 
medium at high speed without increasing the requirement for compression data storage 
capacity and without requiring much time in outputting thumbnail images. 
[0082] Other and more specific embodiments of the present invention include an 

image decompression apparatus, an image decompression method, a program, and a 
recording medium for conducting high speed decompression of compressed image data 
generated from the compression technique of the present invention or decompression of 
compressed image data by using information generated from the compression technique of 
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the present invention. 

[0083] Other and more specific embodiments of the present invention include an 

image compression/decompression apparatus, an image compression/decompression method, 
a program, or a recording medium using the compression technique and the decompression 
technique of the present invention. 

[0084] Other embodiments and further features of the present invention will become 

apparent from the following detailed description when read in conjunction with the 
accompanying drawings. 

[0085] In the following, embodiments of the present invention are described with 

reference to the accompanying drawings. 

[0086] Encoded data that are processed in the embodiment of the present invention 

explained below are encoded data (hereinafter also referred to as compressed data) of a still 
image of JPEG 2000 (ISO/IEC FCD 15444-1), and encoded data of a moving picture of 
Motion- JPEG 2000 (ISO/IEC FCD 15444-3). In Motion-JPEG 2000, the moving picture is 
realized by a series of continuous still images, each image serving as a frame, and the 
encoded data of each frame are based on JPEG 2000, with the only difference being the file 
format that differs from JPEG 2000 in part. 

[0087] JPEG 2000 is an image compression/decompression method chosen as an 

international standard in 2001 as a successor of JPEG. Details of the algorithm of JPEG 2000 
are available from published books, such as "Next-generation Image Coding System JPEG 
2000" by Yasuyuki Nomizu (Triceps, Inc.). 

[0088] Fig. 1 is a block diagram for illustrating an algorithm of hierarchical 

encoding/decoding with JPEG 2000, and is also a block diagram serving to explain an image 
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compression (and/or decompression) apparatus according to an embodiment of the present 
invention. 

[0089] The algorithm of JPEG 2000 is configured by a two-dimensional wavelet 

transform portion 2, a quantization portion 3, an entropy coding portion 4, and a tag 
processing portion 5. The two-dimensional wavelet transformation portion 2, the 
quantization portion 3, and the entropy coding portion 4 serve to process data that are 
input/output from/to a color space conversion portion (color conversion portion) 1 and also 
data input/output from/to the tag processing portion 5. The portions may be arranged in a 
reverse direction. Further, the process conducted by each of the portions may be performed 
on data of each component of a targeted image. 

[0090] Fig. 2 is a simplified diagram showing a flow of the algorithm of JPEG 2000. 

In a compression process, each component of image data is subjected to color space 
conversion in step S2. Then, wavelet transformation is performed on each of the components 
to obtain wavelet coefficients (step S3). Then, the coefficients of the wavelets are subjected 
to progressive-sub-bit-plane encoding (quantization) (step S4) and then entropy encoding 
(step S5). On the other hand, in a decompression process, wavelet coefficients for each 
component obtained from entropy decoding (step S5) and inverse quantization (step S4) are 
subjected to inverse wavelet transformation (step S3) followed by inverse color conversion 
(step S2), to thereby return to the original RGB image as shown in step SI. 
[0091] Next, the algorithm of JPEG 2000 is described in detail. 

[0092] In comparison with the conventional JPEG algorithm, one of the most 

significant differences is the method of transformation. While a DCT (Discrete Cosine 
Transform) method is applied to the conventional JPEG, a DWT (Discrete Wavelet 
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Transform) method is applied to the hierarchical coding algorithm of JPEG 2000. The DWT 
method, in comparison with the DCT method, is advantageous in that high quality images can 
be provided in areas compressed at high levels. This is one major reason for employing the 
DWT method in the JPEG 2000 algorithm that serves as a successor of the JPEG algorithm. 
As another significant difference, a functional block referred to as the "tag processing unit 5" 
is added for executing code formation at the final stage of the system. In the tag processing 
unit 5, compressed data are generated in the form of code stream data during an image 
compression process, and code stream data required to be decompressed are interpreted 
during a decompression process. By using the code stream data, JPEG 2000 is able to 
provide a variety of useful functions. Other than being able to provide satisfactory image 
quality under high compression rate (low bit rate), the algorithm of JPEG. 2000 has many 
other useful features. 

[0093] One of the JPEG 2000 features is being able to adjust the amount of the 

encoded data without performing recompression by post-quantization by discarding 
(truncation) of codes of the encoded data. The code discarding (truncation) can be performed 
in various units, such as domains of tiles, precincts, components, decomposition levels (or 
resolution levels), bit planes, sub-bit planes, packets, and layers in the case of a multi-layer 
structure. 

[0094] For example, Fig. 3 shows sub-bands in each decomposition level in a case of 

three decomposition levels. The process of compressing/decompressing still images can be 
stopped at a given level subjected to octave division in which an image is divided in a block 
basis by performing DWT as shown in Fig. 3. As for the relations between decomposition 
levels and resolution levels, the resolution level is 0 with respect to sub-band 3LL, the 
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resolution level is 1 with respect to sub-bands 3HL, 3LH, 3HH, the resolution level is 2 with 
respect to sub-bands 2HL, 2LH, 2HH, and the resolution level is 3 with respect to sub-bands 
1HL, 1LH, and 1HH. According to "JPEG 2000 Part 1, FDIS (Final Draft International 
Standard)," the term "decomposition level" is defined as follows: 

"A collection of wavelet subbands where each coefficient has the same spatial impact or span 
with respect to the source component samples. These include the HL, LH and HH subbands 
of the same two-dimensional subband decomposition. For the last decomposition level the 
LL subband is also included." 

[0095] Another JPEG 2000 feature is being able to restructure the layer of the 

encoded data under a code state, that is, the encoded data as they are. Another feature is 
being able to restructure the encoded data of a certain progression sequence to encoded data 
of another progression sequence under the code state. Further, another feature is being able 
to divide the encoded data of a multi-layer structure into two or more sets of encoded data in 
units of layers under the code state. 

[0096] Next, the algorithm of JPEG 2000 is further described in detail step by step. 

[0097] In many cases, the color-space transformation/inverse transformation unit 1 (as 

shown in Fig. 1) is connected to an input/output unit for an original image. The color-space 
transformation/inverse transformation unit 1 performs color-space transformation/inverse 
transformation, for example, transformation/inverse transformation from an RGB color 
expression system (comprising primary color components of Red (R), Green (G), and Blue 
(B)) or a YMC color expression system (comprising complementary color components of 
Yellow (Y), Magenta (M), and Cyan (C)) to a YUV or YCbCr color expression system. 
[0098] Fig. 4 is a diagram for illustrating an example of components of an original 

image divided into tiles. 
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[0099] Generally, with color images, components 7 R , 7g, 7 b (in this embodiment, 

components of an RGB color expression system) of an original image are divided into 
respective rectangular domains (tiles) 7 Rt , 7 Gt , 7 Bt in a manner shown in Fig. 4. Each of the 
tiles (in the example shown in Fig. 4, R00, R01, — , R15/G00, G01, — f G15/B00, B01, — , 
B15) serves as a basic unit on which an image data compression/decompression operation is 
conducted. Accordingly, components of image data (image data of each frame in a case of 
processing moving pictures) targeted for compression/decompression are divided into 
rectangular domains that are not overlapped (referred to as tiles) and are processed in tile 
units. That is, the image data compression/decompression operation is conducted 
independently for each component and each tile. However, it is also possible to allow the tile 
size to be the same as the size of the image. That is, it is also possible not to conduct such 
tile division. 

[00100] In an image data encoding operation, image data of each tile of each 
component are input to the color-space conversion/inverse conversion unit 1 (see Fig. 1), at 
which color-space conversion is performed. Subsequent to the color-space conversion, the 
image data are subjected to two-dimensional wavelet transformation in the two-dimensional 
wavelet transformation/inverse transformation unit 2, and are spatially divided into frequency 
bands. It is to be noted that this color space conversion may be skipped. 
[00101] Fig. 3 shows sub-bands in each decomposition level in a case where the 
number of decomposition levels is 3. That is, an original image tile (0 LL) (decomposition 
level 0 (6o)) is decomposed by the two-dimensional wavelet transform, into sub-bands of 
decomposition level 1 (60, namely, ILL, 1HL, 1LH, and 1HH. That is, the original image 
tile (6 0 ) is divided into the sub-bands shown on decomposition level 1 (6i). Then, the low 
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frequency sub-band ILL on decomposition level 1 is subjected to two-dimensional wavelet 
transformation to be further decomposed into sub-bands, namely, 2LL, 2HL, 2LH, and 2HH 
on decomposition level 2 (6 2 ). Similarly, the low frequency sub-band 2LL is subjected to 
two-dimensional wavelet transformation to be further decomposed into sub-bands, namely, 
3LL, 3HL, 3LH, and 3HH on decomposition level 3 (63). Here, taking all of the 
decomposition levels, the sub-bands targeted for encoding are sub-bands 3HL, 3LH, 3HH, 
2HL, 2LH, 2HH, 1HL, 1LH, and 1HH, in a case of, for example, three decomposition levels. 
In this case, sub-band 3LL is not targeted for encoding. 

[00102] Next, bits targeted for encoding are determined in a prescribed encoding 
sequence for allowing the quantization unit 3 (shown in Fig. 1) to generate a context from the 
bits surrounding the encoding targeted bits. That is, the coefficients of the wavelets obtained 
by recursive division (octave division) of a low frequency component (LL sub-band 
coefficient), as described above, are quantized for every sub-band in the quantization unit 3. 
In JPEG 2000, both "lossless" (reversible) compression and "lossy" (irreversible) 
compression are possible. If lossless compression is carried out, quantization step width is 
always set at 1, and the data are not quantized at this stage. The wavelet coefficients that 
have been quantized, for example, increase to 12 bits with respect to 8 bits in the original 
image. 

[00103] After quantization, in the entropy encoding unit, the tiles of each component 
are encoded by probability estimation in accordance with context and encoding targeted bits. 
Thereby, entropy encoding of each sub-band coefficient is carried out. As for the entropy 
encoding, a coding system called EBCOT (Embedded Block Coding with Optimized 
Truncation) is used that includes block division, coefficient modeling, and binary arithmetic 
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coding. A bit plane of each sub-band coefficient after quantization is encoded for every block 
(called "code block") from a higher rank plane to a lower rank plane. 
[00104] In the tag processing unit 5, a code generating process is conducted. In the 
code generating process, the encoded data from the entropy encoding unit 4 are combined 
into a single code stream, and tag information is added thereto. In the tag processing unit 5, 
packets are generated by collecting codes of the code blocks generated in the entropy 
encoding unit 4. The generated packets are put in order according to a sequence of 
progression (progression sequence), and tag information is added, such that encoded data in a 
predetermined format are generated. As for the sequence control, the progression sequence 
of JPEG 2000 is defined by, for example, a resolution level, a precinct (position), a layer, and 
a component (color composition). 

[00105] Next, the entropy encoding process in the entropy coding unit 4 and the code 

generating process in the tag processing unit 5 are described in detail. 

[00106] Wavelet coefficients having undergone the quantization process are divided 

into non-overlapped rectangles referred to as "precincts" for each sub-band. This is 

introduced in order to efficiently use memory during an implementation process. Further, 

each precinct is divided into non-overlapped rectangular "code blocks." 

[00107] Here, a brief explanation is presented about the precinct, the code block, the 

packet, and the layer. The following size relations exist: image>=tile>=sub- 

band>=precinct>=code bock. 

[00108] A precinct is one or more rectangular domains of sub-bands. A group of three 
domains of sub-bands HL, LH, and HH belonging to the same decomposition level and 
having the same relative spatial position, are treated as a precinct. In the case of the LL sub- 
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band, however, one domain alone is treated as a precinct. Here, it is also possible to make the 
size of the precinct be the same size as the sub-band. Further, a rectangular domain that is a 
division of a precinct is a code block. The packet is a collection (assembly) of parts of codes 
(for example, the codes of three sheets of the bit planes, i.e., from MSB to the third bit) of all 
the code blocks of the precinct. An empty packet is also allowed. Packets are generated by 
collecting the codes of the code blocks, and are arranged in a desired progression sequence, 
such that encoded data are generated. With reference to Fig. 9, the portion that follows SOD 
of each tile header represents a set of the packets. 

[00109] A layer is generated by collecting the packets of all the precincts (that is, all 
the code blocks, and all the sub-bands), the layer being a part of codes of the entire image 
region (for example, codes of the highest tier bit plane through codes of the third tier bit 
plane of the wavelet coefficients of the entire image region). However, it is not necessary that 
the layer include the packets of all the precincts, as described later. Accordingly, where there 
are a larger number of layers that are decoded at the time of decompression, a higher quality 
image can be reproduced. Accordingly, the layer serves as a unit for representing image 
quality. If all the layers are collected, the codes of all the bit planes of the entire image region 
are obtained. 

[00110] Fig. 5 is a diagram for illustrating the relation between precincts and code 
blocks. Figs. 6 through 8 are tables showing an example of packets and layers in a case of 
decomposition level 2 (resolution level=3), in which Fig. 6 shows an example of a typical 
layer structure, Fig. 7 shows an example of a layer structure that allows thumbnails to be 
output to corresponding devices, and Fig. 8 shows an example of a layer structure that allows 
thumbnails to be output in accordance with the capacity of transmission lines. 
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[00111] The wavelet coefficients having gone through the process of quantization are 
divided into precincts for each sub-band. In Fig. 5, one precinct (for example, precinct 8p4) is 
formed of three rectangular domains having the same relative spatial position. Another such 
precinct is precinct 8p6>. That is, a group of three domains having the same relative spatial 
position (indicated as precincts in Fig. 5) is treated as one precinct. Here, an original image 8 
is divided into four tiles at decomposition level 1, namely, tiles 8 t o, 8 t i, 8 t2 , and 8^. Further, 
each precinct is divided into non-overlapping rectangular code blocks (e.g. code blocks 841,0, 
84bi, in precinct 8 P 4). The code blocks serve as a basic unit during entropy encoding in the 
entropy encoding/decoding unit 4. 

[00112] In order to enhance encoding efficiency, coefficients may be decomposed into 
units of bit planes that are arranged in sequence for each pixel or code block, to thereby allow 
a layer of one or more bit planes to be formed. That is, layers are structured according to the 
significance of the coefficients of the bit planes, and the encoding process is conducted for 
each of the layers. In one example, only the most significant layer (MSB) and few layers 
ranked lower than the MSB are subjected to encoding, and the other remaining layers 
including the lowest ranked layer (LSB) are truncated. 

[00113] Fig. 6 shows an example of packets and layers (number of layers = 10), where 
the decomposition level is set at 2 (resolution level = 3). In Fig. 6, the small vertically 
elongated rectangles are packets, and the numbers indicated inside the packets are packet 
numbers. Layers are illustrated as horizontally elongated rectangular domains with different 
shades. That is, in this example, layer 0 includes the packets of the packet numbers 0 through 
51, layer 1 includes the packets of the packet numbers 52 through 72, layer 2 includes the 
packets of the packet numbers 73 through 93, layer 3 includes the packets of the packet 
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numbers 94 through 1 14, layer 4 includes the packets of the packet numbers 1 15 through 135, 
layer 5 includes the packets of the packet numbers 136 through 156, layer 6 includes the 
packets of the packet numbers 157 through 177, layer 7 includes the packets of the packet 
numbers 178 through 198, layer 8 includes the packets of the packet numbers 199 through 
215, and layer 9 includes the packets of the remaining packet numbers 216 through 228. The 
relations between the packets and the precincts, etc., vary depending on the progression 
sequence, the number of divided layers, etc. Therefore, the layer structure as described above 
is merely one example. 

[00114] Fig. 7 shows an example of a layer structure allowing thumbnails to be output 
according to a corresponding device. Although this example has a structure similar to that of 
the layer structure of Fig. 6, thumbnail information (packet numbers 2, 10, 18, 26, 54, 75) 
illustrated with a same shade is set as correspondence information, which is to be recorded in 
a recording medium or a header portion of compressed data, for providing a thumbnail 
display for a digital camera, for example. Thumbnail information for providing a thumbnail 
display for image viewing software may also be set (packet numbers 96, 1 17). Thumbnail 
information for providing a display for a mobile telephone may also be set (2LL). In one 
embodiment of the present invention, compressed image data are generated in accordance 
with the correspondence information. 

[00115] Fig. 8 shows an example of a layer structure allowing thumbnails to be output 
according to the capacity of a transmission line. In this example, the number of layers is 13 
and the decomposition level is set at 2 (resolution level = 3). In this example, layer 0 
includes the packets of the packet numbers 0 through 3 shown with the same shade; layer 1 
includes the packets of the packet numbers 4 through 1 1 shown with the same shade; layer 2 
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includes the packets of the packet numbers 4 through 7 and packet numbers 12 through 19 
shown with the same shade; layer 3 includes the packets of the packet numbers 12 through 15 
and packet numbers 20 through 51 shown with the same shade; layer 4 includes the packets 
of the packet numbers 52 through 72 shown with the same shade; layer 5 includes the packets 
of the packet numbers 73 through 93 shown with the same shade; layer 6 includes the packets 
of the packet numbers 94 through 1 14 shown with the same shade; layer 7 includes the 
packets of the packet numbers 1 15 through 135 shown with the same shade; layer 8 includes 
the packets of the packet numbers 136 through 156 shown with the same shade; layer 9 
includes the packets of the packet numbers 157 through 177 shown with the same shade; 
layer 10 includes the packets of the packet numbers 178 through 198; layer 1 1 includes the 
packets of the packet numbers 199 through 215 shown with the same shade; and layer 12 
includes the packets of the packet numbers 216 through 228 shown with the same shade. The 
relations between the packets and the precincts, etc., vary depending on the progression 
sequence, the number of divided layers, etc. Therefore, the layer structure as described above 
is merely one example. 

[00116] In each of the layer structures shown in Figs. 6 through 8, encoded data are 
divided as packets being sequentially added, starting from a packet with a low packet number, 
until reaching a prescribed size. One layer is determined upon reaching the prescribed size. 
In the aforementioned layer structures, each bit plane is divided into sub-bit planes, namely, 
Refinement, Significant, and Cleanup. Nevertheless, more accurate control can be obtained 
by dividing the bit planes into more sub-bit planes. Furthermore, the priority in the sequence 
of the packets can be altered so that, for example, the packets may be arranged in a sequence 
where importance is placed on resolution, image quality, or position. The layer structures 
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shown in Figs. 6 through 8 correspond to the example described in Step S5 of Fig. 2. 
[00117] Fig. 9 is a data diagram showing the format of the encoded data of JPEG 2000 
generated in the code generating process (code stream structure). Various tag information is 
added to the encoded data. That is, the encoded data start with an SOC marker 9 S indicating 
the start of the code stream, followed by a main header (Main Header) 9h describing a coding 
parameter, a quantization parameter, etc., and further followed by encoded data for every tile, 
as shown in Fig. 9. The encoded data for every tile starts with an SOT marker 9 st , followed 
by a tile header (Tile Header) 9th, an SOD marker 9 sc j, and tile data (Tile Data; encoded data 
(bit stream 9 b )). A tag that defines the end (EOC tag 9 e ) is placed at the end of the code 
stream (after the final tile data). 

[00118] Fig. 10 is a diagram showing the structure of the main header 9h of Fig. 9. 
[00119] As shown in Fig. 10, following the image and the tile size (SIZ), the main 
header 9h includes: coding style default (COD; requisite); a coding style component (COC); 
quantization default (QCD; requisite); quantization component (QCC); ROI (region of 
interest) (RGN); progression order change (POC); packed packet header (PPM); tile part 
length (TLM); packet length (PLM); color registration (CRG); and comment (COM). Other 
than SIZ and marker segments indicated as requisite (COD, QCD), other components are 
optional. 

[00120] Fig. 1 1 shows a structure of a file format of a JPEG 2000 scheme. 
[00121] The file format of the JPEG 2000 scheme is referred to as the JP2 file format, 
and includes the JPEG 2000 coding format described in Fig. 9. The JP2 file format is a 
format aiming to include information such as image data, meta data, information indicating 
image property (e.g., gradation value, color space), and/or information on intellectual 
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property rights. The information structure of the JP2 file, being formed by the JP2 file format, 
is composed of sectors of information (referred to as boxes), and includes information 
specialized for applications (referred to as meta data). As illustrated with solid lines 
(requisite) and broken lines (optional) in Fig. 1 1, the information structure of the JP2 file 
includes JPEG 2000 Signature box, File Type box, JP2 Header box, and a Contiguous 
Codestream box. The details thereof are illustrated in Fig. 11. 
[00122] Meanwhile, in a decoding process, image data are generated from the 
codestream of each tile of each component. This process is described with reference to Fig. 1. 
The tag processing unit 5 interprets the tag information attached to the code stream input 
from the exterior, then the code stream is decomposed into code streams for each tile of each 
component, and then decoding (decompression) is performed for every code stream of each 
tile of each component. Along with determining the positions of bits that are targeted for 
decoding in accordance with the sequence based on the tag information in the code stream, 
the context is produced from the arrangement of peripheral bits (already decoded) in the 
quantization/inverse quantization unit 3. In the entropy encoding/decoding unit 4, decoding 
is performed by probability estimation according to the code stream and the contexts, to 
thereby reproduce the targeted bits. The targeted bits are disposed at the relevant pixel 
position. Accordingly, since the decoded data are spatially divided into respective frequency 
bands (sub-bands), each tile of each component of the image data is restored by performing a 
two-dimensional wavelet inverse transformation in the two-dimensional wavelet 
transverse/inverse transform unit 2. The obtained restored data are transformed into image 
data of the original color system by the color space transform/inverse transform unit 1. 
[00123] Next, an embodiment according to the present invention is described in detail. 
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[00124] Fig. 12 is a functional block diagram for illustrating an example of a structure 
of an image compression apparatus according to an embodiment of the present invention. Fig. 
13 is a flow chart for illustrating an example of an image compression method according to 
an embodiment of the present invention and the exemplary image compression apparatus 
shown in Fig. 12. 

[00125] The image compression apparatus according to an embodiment of the present 
invention is an apparatus that generates compressed image data, and includes a code size 
determining unit, a compressing unit, and a code generating unit. Fig. 12 shows an image 
compression apparatus 20 having: an image reading unit 21; an image size setting unit 22 that 
includes the code size setting unit; an image compressing unit 23 that includes the 
compressing unit; an image quality dividing unit 24; and a code generating unit 25 that 
includes the code generating unit. 

[00126] The code size setting unit sets at least one code size (an example is described 
below). The compressing unit divides an image (may also be code data of a compressed 
image) into plural image quality levels and compresses the image according to the code size 
set by the code size setting unit. The code generating unit generates code that is easily 
dividable in accordance with each code size that has been set. Here, "easily dividable" 
implies that a point for allowing an image to be divided by a suitable size can be located 
easily during decompression of compressed image data. For example, an image can easily be 
divided in units of layers, wherein the layers are formed to allow easy display for a mobile 
phone (described below). For example, in structuring layers by the cutting of packets in a 
case where there is a predetermined size, a layer is formed so that the predetermined size can 
fit in layer 1 . In a case where an image with a size of higher quality is desired to be cut out, 
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another layer may be formed according to such desire. 

[00127] With the image compressing apparatus 20, the image reading unit 21 (may also 
be referred to as "code reading unit") reads image data (may also be referred to as 
compressed data of a compressed image or un-compressed data; image file) (Step SI 1), and 
then, the image size setting unit 22 sets the size for dividing image quality (Step S12). The 
setting of the size may be conducted beforehand. Then, the number of parts for division is set 
(Step SI 3). Then, the image quality dividing unit 24 divides the image into plural image 
quality levels (Step SI 5) until the set number of parts are satisfied (until the relation in Step 
S14 becomes "NO"). Then, the image compressing unit 23 compresses the image, and then, 
the code generating unit 25 generates code that is easily dividable in accordance with each 
code size that has been set (Step SI 6). 

[00128] Fig. 14 shows an example of a correspondence relation used for the image 
compression apparatus shown in Fig. 12. 

[00129] The image compression apparatus 20 has a correspondence relation stored 
therein. An example of a correspondence relation where image quality level is a layer is 
illustrated with a correspondence table 30 in Fig. 14. The correspondence table 30 is a table 
showing a correspondence relation between transmission line capacity (bps) 31 and image 
quality 32, wherein layer 10 (most significant layer) corresponds to a transmission line 
having a transmission line capacity of 5.6 K bps, layer 7 corresponds to a transmission line 
having a transmission line capacity of 1 M bps (layers 7 through 0 may, for example, be 
truncated; hereinafter the same), layer 5 corresponds to a transmission line having a 
transmission line capacity of 8 M bps, layer 4 corresponds to a transmission line having a 
transmission line capacity of 10 M bps, layer 2 corresponds to a transmission line having a 
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transmission line capacity of 100 M bps, and layer 0 corresponds to a transmission line 
having a transmission line capacity of 1 G bps. Here, an acceptable required time may be set, 
and a targeted image quality may be set in accordance with respective speeds. Although the 
image quality level 32 shown in Fig. 14 is based on the examples of the layer structures of 
Figs. 6 through 8; the layers are denoted in accordance with setting. 
[00130] Before structuring of the layers, one packet is distributed to each precinct of 
each sub-band (for example, bit 1 through bit 12 that amounts to 12 bits). In one exemplary 
method for structuring the layers, layer 0 is formed by extracting packets only from portions 
of an image having the most significance until reaching a size that allows an image to be cut 
down to minimal size in a case where the transmission line capacity is 5.6 K bps. Next, in 
the same manner, layer 1 is formed by adding packets until reaching a size suitable for a 
transmission line having a transmission line capacity of 1 M bps. The following layers are 
also formed in the same manner. 

[00131] An image compression apparatus according to another embodiment of the 
present invention may include an embedding unit that embeds a correspondence relation 
between set values and code sizes corresponding to each of the set values into the code. By 
allowing the code to retain the correspondence relation of code size and a corresponding set 
value, decompression can easily be conducted at high speed. The embedding unit may 
conduct storage or temporary storage before embedding the correspondence relation into the 
code. The embedding unit may embed a correspondence relation as thumbnail information 
into a header portion of compressed data read by the image reading unit 21 or code data 
divided by the image dividing unit 24. 

[00132] As exemplary alternative locations for embedding thumbnail information 
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(recording location), there are, for example, the COM markers in Fig. 10, the file format 
XML boxes in Fig. 1 1, the file format UUID boxes in Fig. 1 1, etc. An exemplary XML 
description is given below. 

XML description 

<?xml version=" 1.0" encoding="Shift-JIS"?> 
<!DOCTYPE html 

PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" 
"http://www.w3.org/TR/xhtmll/DTD/xhtmll-strict.dtd M > 
<html xmlns= M http://www.w3.org/1999/xhtmr xml:lang="ja" lang="ja"> 
<head> 

<title>THUMBNAIL</title> 

</head> 

<body> 

<p> 3 LL </p> 
</body> 
</html> 

[00133] In the image compression apparatus according to the embodiments of the 
present invention shown in Figs. 12 through 14, a correspondence relation between image 
quality and code size is obtained by dividing an image into plural image quality levels. 
However, in an image compression according to another embodiment of the present invention, 
a rectangular domain may be used instead of image quality. Here, code data of a compressed 
image are divided into plural rectangular domains. Here, the image quality dividing portion 
24 includes a dividing unit that divides image data (may also be code data of a compressed 
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image) into plural rectangular domains, and the image size setting unit 22 includes a size 
setting unit that sets code size (code amount) corresponding to each rectangular domain. A 
compression unit regulates and compresses each of the rectangular domains to the set code 
size. Further, in accordance with the obtained correspondence relation between the domains 
and the code sizes, code is generated (and further, embedding into the code is conducted). As 
a result, an image can be compressed in accordance with code amount (code size) being set in 
correspondence to respective domains. A dividing unit that is able to divide code data based 
on tiles, precincts, or code blocks may be provided. That is, the domain on which the 
division is conducted may be a tile, a precinct, or a code block. 

[00134] Further, in an image compression according to another embodiment of the 
present invention, a color component may be used instead of a rectangular domain. Here, 
code data of a compressed image are divided into plural color components. Here, the image 
quality dividing portion 24 includes a dividing unit that divides image data (may also be code 
data of a compressed image) into plural color components, and the image size setting unit 22 
includes a size setting unit that sets code size (code amount) corresponding to each color 
component. A compression unit regulates and compresses each of the color components to 
the set code size. Further, in accordance with the obtained correspondence relation between 
the color components and the code sizes, code is generated (and further, embedding into the 
code is conducted). As a result, an image can be compressed in accordance with code 
amount (code size) being set in correspondence to respective color components. 
[00135] Further, in an image compression according to another embodiment of the 
present invention, a resolution level (resolution) may be used instead of a rectangular domain. 
Here, code data of a compressed image are divided into plural resolutions. Here, the image 
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quality dividing portion 24 includes a dividing unit that divides image data (may also be code 
data of a compressed image) into plural resolutions, and the image size setting unit 22 
includes a size setting unit that sets code size (code amount) corresponding to each resolution. 
A compression unit regulates and compresses the data of each of the resolutions to the set 
code size. Further, in accordance with the obtained correspondence relation between the 
resolutions and the code sizes, code is generated (and further, embedding into the code is 
conducted). As a result, an image can be compressed in accordance with code amount (code 
size) being set in correspondence to respective resolutions. 

[00136] Further, in an image compression according to another embodiment of the 
present invention, a packet may be used instead of a rectangular domain. Here, code data of 
a compressed image are divided into plural packets. Here, the image quality dividing portion 
24 includes a dividing unit that divides image data (may also be code data of a compressed 
image) into plural packets, and the image size setting unit 22 includes a size setting unit that 
sets code size (code amount) corresponding to each packet. A compression unit regulates and 
compresses each of the packets to the set code size. Further, in accordance with the obtained 
correspondence relation between the packets and the code sizes, code is generated (and 
further, embedding into the code is conducted). As a result, an image can be compressed in 
accordance with code amount (code size) being set in correspondence to corresponding 
packets. 

[00137] Next, a code size (at least one code size) that is set by a code size setting unit 
is described. 

[00138] The code setting unit 22 includes a setting unit that sets a type of transmission 
line at least of one kind, and a size setting unit that sets a code size (may also be an image 
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size) in accordance with the type of transmission line that has been set. The compression unit 
compresses an image by dividing image data into plural image quality levels according to a 
set code size. Then, the code generating unit generates code that is easily dividable in 
accordance with each code size that has been set by the code size setting unit. The code size 
set by the code size setting unit may be based on the type of transmission line, for example, 
"Ethernet (trademark) (100 M bps)," "Ethernet (trademark) (1 G bps)," "Ethernet (trademark) 
(10 M bps)," "Optical Cable (1.1 G bps)," "ADSL (8 M bps)," and/or "Dial-up line (5.6 K 
bps)." 

[00139] Instead of setting the code size based on the type of transmission line, the code 
size may be set based on the capacity of a transmission line, for example, "100 M bps 
(Ethernet (trademark))," "1 G bps (Ethernet (trademark))," "10 M bps (Ethernet 
(trademark))," "1.1 G bps (Optical Cable)," "8 M bps (ADSL)," and/or "5.6 K bps (Dial-up ; 
line)." 

[00140] Instead of setting the code size based on the type of transmission line, the code 
size may be set based on the type of image display apparatus, for example, a mobile phone, a 
CRT, and/or a printer. 

[00141] Instead of setting the code size based on the type of transmission line, the code 
size may be set based on display resolution (display resolution of an image display apparatus), 
for example, VGA, XVGA, and/or QCIF. 

[00142] Instead of setting the code size based on the type of transmission line, the code 
size may be set based on the processing speed of an image display apparatus, for example, in 
a CPU with a clock of 500 MHz, 1 GHz, and/or 2 GHz. 

[00143] In the above-given description, a process of generating code according to a 
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correspondence relation (it is to be noted that a truncation process may be conducted during 
the code generation) or a process of embedding a correspondence relation into code is 
conducted with the image compression apparatus according to the embodiments of the 
present invention. Next, an image decompression apparatus employed with the 
aforementioned image compression apparatus according to the embodiments of the present 
invention is described. 

[00144] The image decompression apparatus decompresses compressed data generated 
by the image compression apparatus. The image decompression may, for example, include a 
decompression unit that decompresses code or information generated by the image 
compression apparatus in accordance with a correspondence relation between a set value and 
a code size corresponding to the set value. It is to be noted that one embodiment of the 
present invention may also be provided as an image compression/decompression apparatus 
that includes the aforementioned image compression apparatus and the decompression unit. 
[00145] Next, an exemplary output result of decompressing a compressed image with 
an image decompression apparatus (image compression/decompression apparatus) according 
to the embodiments of the present invention is described. 

[00146] Fig. 15 shows an example of an original image 40, and Figs. 16A through 16D 
shows the results of compressing the original image 40 in Fig. 15 with the image 
compression apparatus according to an embodiment of the present invention and outputting 
the image with the image decompression apparatus according to an embodiment of the 
present invention. 

[00147] In a case of designating a low-resolution image of the original image 40 in 
accordance with the correspondence relation, an image 41 as shown in Fig. 16A is output. 
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Similarly, in a case of designating a single component in accordance with the correspondence 
relation, an image 42 as shown in Fig. 16B is output; in a case of designating only layer 0 in 
accordance with the correspondence relation, an image 43 as shown in Fig. 16C is output; 
and in a case of designating tiles of a center portion in accordance with the correspondence 
relation, an image 44 as shown in Fig. 16D is output. 

[00148] In consequence, the image compression apparatus according to the 
embodiments of the present invention generates compressed image data that allow 
thumbnails of an image to be quickly output without requiring a large space for storing 
compressed image data. Accordingly, a process of transforming an image into a form that is 
suited for a given output device can be conducted at high speed. Further, the point for 
dividing an image to a suitable size can be easily located with the image data compressed by 
the image compression apparatus. For example, a correspondence relation may be recorded 
in the header information of the compressed data or to a recording medium in an image 
processing apparatus. Accordingly, an image transmission system, for example, transmits 
compressed data having a dividing point that is easy to locate, compressed image data having 
a correspondence relation embedded in a header portion thereof, or correspondence relation 
and compressed data separately. 

[00149] Furthermore, the image decompression apparatus (image 
compression/decompression apparatus) according to one embodiment of the present 
invention is able to quickly decompress compressed image data generated by the 
aforementioned compression technique. The image decompression apparatus according to 
another embodiment of the present invention is able to quickly decompress compressed 
image data based on information generated by the aforementioned compression technique. 
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[00150] Although description of the embodiments of the present invention is given 
above mainly in the form of an image compression apparatus, an image decompression 
apparatus, and an image compression/decompression apparatus, one embodiment of the 
present invention may be provided in the form of an image compression method, an image 
decompression method, or an image compression/decompression method that includes the 
processes conducted by the foregoing apparatuses as shown with the steps in Fig. 13. Further, 
one embodiment of the present invention may be provided in the form of a program enabling 
a computer to function as the foregoing apparatuses or to execute the foregoing methods (a 
program having the foregoing processes installed therein). Further, one embodiment of the 
present invention may be provided in the form of a computer-readable recording medium 
having the aforementioned program recorded thereto (a computer-readable recording medium 
having the aforementioned processes recorded thereto). Furthermore, one embodiment of the 
present invention may also be provided in the form of a system that provides the same 
advantages of the foregoing apparatuses such as generating compressed image data that allow 
thumbnails of an image to be quickly output without requiring a large space for storing 
compressed image data. The aforementioned program and recording medium can be easily 
executed by following the description of the aforementioned embodiments and the 
description given below. 

[00151] An example of a program and a recording medium having the program stored 
therein for providing an image compression function and/or an image decompression 
function according to one embodiment of the present invention is next described. As 
examples of the recording medium, there are a CD-ROM, a magnetic optical disk, a DVD- 
ROM, a flexible disk, a flash memory, and other various kinds of ROM and RAM. At least 
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one of the functions of image compression and image decompression can easily be achieved 
by providing such a recording medium that has a program enabling a computer to perform the 
aforementioned functions of one embodiment of the present invention recorded thereto. The 
function of one embodiment of the present invention can be executed, for example, in the 
form of mounting the recording medium to an information processing apparatus (e.g. 
computer or an apparatus of the like), reading out the program by starting up the program or 
by transmitting the program to another apparatus, or in the form of storing the program in a 
storage medium of the information processing apparatus and reading out the program when 
necessary. 

[00152] Here, an example of a structure of an apparatus applicable for the foregoing 
embodiment is described. 

[00153] Fig. 17 is an example showing a structure of an image compression apparatus 
and/or an image decompression apparatus according to one embodiment of the present 
invention. 

[00154] This example of the image compression apparatus according to one 
embodiment of the present invention includes a RAM 51, a CPU 52, and an HDD 54 that are 
connected with a data bus 53. According to the flow described below, compressed data that 
are easily dividable are generated from the image data (may also be compressed data) of an 
original image and are stored in the HDD 54. It is to be noted that, the original image data 
are generated from the compressed data in the opposite order and are stored in the HDD 54 in 
a case of the image decompression apparatus according to one embodiment of the present 
invention, so further details in the case of the image decompression apparatus are omitted. 
[00155] In the flow of the image compression apparatus according to one embodiment 



Patent Application 
1702O4/(MJM:d!r) 



Page 40 of 52 



006453 .P037 

Express Mail Label No. EV 409361254 US 



of the present invention, first, image data (or compressed image data) of the original image 
stored in the HDD 54 are read into the RAM 51 in compliance to a command from the CPU 
52 (i). Then, the CPU 52 reads the image data in the RAM 51, obtains wavelet coefficients, 
and generates compressed image data by applying the processes of one embodiment of the 
present invention including, for example, code generation (ii). Then, the CPU 52 writes the 
generated compressed image data to another area in the RAM 51 (iii). Then, the compressed 
image data are recorded onto the HDD 54 according to commands from the CPU 52 (iv). 
Meanwhile, from the aspect of the image decompression apparatus, for example, a thumbnail 
can be output based on thumbnail information recorded in a header portion of the compressed 
image data when outputting the compressed image data for display, printing, or transmittal. 
The example of the image compression apparatus shown in Fig. 17 may also serve as an 
image decompression apparatus. 

[00156] Hence, with one embodiment of the present invention, compressed image data 
can be generated so that thumbnails of an image can be quickly output without requiring 
large space for storing compressed image data. Accordingly, a process of transforming an 
image into a form that is suited for a given output device can be conducted at high speed. 
[00157] Furthermore, with one embodiment of the present invention, compressed 
image data generated by the aforementioned compression technique can be quickly 
decompressed, or compressed image data based on information generated by the 
aforementioned compression technique can be quickly decompressed. 
[00158] Further, the present invention is not limited to these embodiments, but various 
variations and modifications may be made without departing from the scope of the present 
invention. 
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[00159] The present application is based on Japanese Priority Application No.2003- 
037972 filed on February 17, 2003, with the Japanese Patent Office, the entire contents of 
which are hereby incorporated by reference. 
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